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METHODS AND SYSTEMS FOR RAISING A NUMERICAL VALUE TO A 

FRACTIONAL POWER 



BACKGROUND OF THE INVENTION 

CROSS- REFERENCE TO RELATED APPLICATION 

5 [0001] The following co-pending and co-assigned application contains 

related information and is hereby incorporated by reference: 

[0002] Serial No. 09/ (Attorney Docl<et NO. 1059-CA (2836- 

P116US), entitled "DIGITAL TONE CONTROLS AND SYSTEMS USING THE 
SAME", by inventors Rao, Gangishetti and Dol<ic, filed November 7, 2000, 
10 currently pending; and 

[0003] Serial No. 09/ (Attorney Docket No. 1 068-CA (2836- 

P122US), entitled "SYSTEMS AND METHODS FOR TRANSMITTING BURSTY- 
ASYNCHRONOUS DATA OVER A SYNCHRONOUS LINK" BY Dokic, Joshi 
Mesarovic and Rao, filed January , 2001 , cun-ently pending. 
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FIELD OF THE INVENTION 

[0004] The present invention relates in general to digital signal processing 
and in particular to circuits, systems, and methods for raising a numerical value 
to a fractional power. 

5 DESCRIPTION OF THE RELATED ART 

[0005] In a number of digital signal processing applications it is necessary 

to raise a given numerical value to a fractional power. For example, digital audio 
is commonly compressed using non-linear quantization techniques. In one such 
technique, time domain samples of an analog audio stream are transfomied into 
10 the frequency domain. The resulting frequency domain samples are then raised 
to the 3/4*^ power and then linearly quantized. By raising samples to the ZIA-^^ 
power, the dynamic range of the bitstream is compressed such that the steps in 
the linear quantization operation roughly equalize the relative noise imparted 
over the different amplitude samples. 

1 5 [0006] Current techniques for raising a numerical value to a fractional 

power are difficult to perform, especially in fixed point machines. Consequently, 
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given their importance in digital signal processing applications, new methods and 
systems are required for raising a numerical value to a fractional power. 

SUMMARY OF THE INVENTION 

[0007] A method of calculating x x having a range, and m and n are 
5 integers. The range of x is partitioned into a selected number of intervals and a 
determination is made as to the interval into which x falls. X is normalized with a 
normalization factor calculated for the interval into which x falls to obtain a 
normalized value x' within a normalized range. A value of x' is calculated 
over the normalized range, a value for x is calculated by multiplying x' C^^N) 
1 0 by the renormalization factor calculated for the interval in which x falls. 

[0008] The inventive concepts allow for the precise performance of the 
operation of raising a numerical value to a fractional power. These concepts are 
particularly useful in digital signal processing applications operating on binary 
data, although not necessarily limited thereto. Moreover, implementation of the 
15 inventive principles does not require an inordinate amount of look-up table 
memory or the execution of a burdensome number of additional instructions. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] For a more complete understanding of the present invention, and 
the advantages thereof, reference is now made to the following descriptions 
taken in conjunction with the accompanying drawings, in which: 

[0010] FIGURE 1 A is a diagram of a multichannel audio decoder 
embodying the principles of the present invention; 

[0011] FIGURE 1B is a diagram showing the decoder of FIGURE 1 in an 
exemplary system context; 

[0012] FIGURE 1 C is a diagram showing the partitioning of the decoder 
into a processor block and an input/output (I/O) block; 

[0013] FIGURE 2 Is a diagram of the processor block of FIGURE 1 C; 

[0014] FIGURE 3 is a diagram of the primary functional subblocks of the 
I/O block of FIGURE 1C; 
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[0015] FIGURE 4 is a diagram of tlie interprocessor communications (IPC) 
registers as shown in FIGURE 3; and 

[0016] FIGURE 5 is a flow ctiart illustrating a preferred metiiod of raising a 
numerical value to a functional power in accordance with the inventive principles. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0017] The principles of the present invention and their advantages are 

best understood by referring to the illustrated embodiment depicted in FIGURE 1 
- 5 of the drawings, in which like numbers designate like parts. 

[0018] FIGURE 1 A is a general overview of an audio information decoder 
100 embodying the principles of the present invention. Decoder 100 is operable 
to receive data in any one of a number of formats, including compressed data 
conforming to the AC-3 digital audio compression standard, (as defined by the 
United States Advanced Television System Committee) through a compressed 
data input port CDI. An independent digital audio data (DAI) port provides for the 
input of PCM, S/PDIF, or non-compressed digital audio data. 

[0019] A digital audio output (DAO) port provides for the output of multiple- 
channel decompressed digital audio data. Independently, decoder 100 can 
transmit data in the S/PDIF (Sony-Phillips Digital Interface) format through 
transmit port XMT. 

WSM Docket No. 
2836-P125US 



ATTORNEY DOCKET NO. PATENT 
1075-CA 



[0020] Decoder 1 00 operates under the control of a host microprocessor 
through a host port HOST and supports debugging by an external debugging 
system through the debug port DEBUG. The CLK port supports the input of a 
master clock for generation of the timing signals within decoder 100. 

5 [0021] While decoder 100 can be used to decompress other types of 

compressed digital data, it is particularly advantageous to use decoder 100 for 
decompression of AC-3 Bitstreams. Therefore, for understanding the utility and 
advantages of decoder 100, consider the case of when the compressed data 
received at the compressed data input (GDI) port has been compressed in 
1 0 accordance with the AC-3 standard. 

[0022] Generally, AC-3 data is compressed using an algorithm which 
achieves high coding gain (i.e., the ratio of the input bit rate to the output bit rate) 
by coarsely quantizing a frequency domain representation of the audio signal. 
To do so, an input sequence of audio PCM time samples is transformed to the 
1 5 frequency domain as a sequence of blocks of frequency co-efficients. Generally, 
these overlapping blocks, each composed of 512 time samples, are multiplied by 
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a time window and transformed into the frequency domain. Because tlie blocks 
of time samples overlap, each PCM input sample is represented by two 
sequential blocks factor transformated into the frequency domain. The frequency 
domain representation may then be decimated by a factor of two such that each 
5 block contains 256 frequency coefficients, with each frequency coefficient 
represented in binary exponential notation as an exponent and a mantissa. 

[0023] Next, the exponents are encoded into coarse representation of the 
signal spectrum (spectral envelope), which is in turn used in a bit allocation 
routine that determines the number of bits required to encoding each mantissa. 
1 0 The spectral envelope and the coarsely quantized mantissas for six audio blocks 
(1536 audio samples) are formatted into an AC-3 frame. An AC bit stream is a 
sequence of the AC-3 frames. 

[0024] In addition to the transformed data, the AC-3 bit stream also 
includes additional information. For instance, each frame may include a frame 
1 5 header which Indicates the bit rate, sample rate, number of encoded samples, 
and similar information necessary to subsequently synchronize and decode the 
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AC-3 bit stream. Error detection codes may aiso inserted sucli tliat tlie device 
such as decoder 100 can verify tliat each received frame of AC-3 data does not 
contain any errors. A number of additional operations may be performed on the 
bit stream before transmission to the decoder. For a more complete definition of 
AC-3 compression, reference is now made to the digital audio compression 
standard (AC-3) available from the Advanced Televisions Systems Committee, 
incorporated herein by reference. 

[0025] In order to decompress under the AC-3 standard, decoder 100 
essentially must perfomi the inverse of the above described process. Among 
other things, decoder 100 synchronizes to the received AC-3 bit stream, checks 
for errors and deformats the received AC-3 data audio. In particular, decoder 
100 decodes spectral envelope and the quantitized mantissas. A bit allocation 
routine is used to unpack and de-quantitize the mantissas. The spectral 
envelope is encoded to produce the exponents, then, a reverse transformation is 
perfomied to transform the exponents and mantissas to decoded PCM samples 
in the time domain. Subsequently, post processing of the PCM audio can be 
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performed using various algorithms including digital tone control. Tine final PCM 
is converted to an analog signal via a DAC and then processed by a typical 
analog signal chain to speakers. 

[0026] FIGURE 1 B shows decoder 100 embodied in a representative 
5 system 103. Decoder 100 as shown includes three compressed data input (CDI) 
pins for receiving compressed data from a compressed audio data source 104 
and an additional three digital audio input (DAI) pins for receiving serial digital 
audio data from a digital audio source 105. Examples of compressed serial 
digital audio source 105, and in particular of AC-3 compressed digital sources, 
10 are digital video discs and laser disc players. 

[0027] Host port (HOST) allows coupling to a host processor 1 06, which is 
generally a microcontroller or microprocessor that maintains control over the 
audio system 103. For instance, in one embodiment, host processor 106 is the 
microprocessor in a personal computer (PC) and System 103 is a PC-based 
15 sound system. In another embodiment, host processor 106 is a microcontroller 
in an audio receiver or controller unit and system 103 is a non-PC-based 
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entertainment system such as conventional home entertainment systems 
produced by Sony, Pioneer, and others. A master clock, shown here, is 
generated externally by clock source 107. The debug port (DEBUG) consists of 
two lines for connection with an external debugger, which is typically a PC-based 
device. 

[0028] Decoder 100 has six output lines for outputting multi-channel audio 
digital data (DAO) to digital audio receiver 109 in any one of a number of formats 
including 3-lines out, 2/2/2, 4/2/0, 4/0/2 and 6/0/0. A transmit port (XMT) allows 
for the transmission of S/PDIF data to an S/PDIF receiver 1 1 0. These outputs 
may be coupled, for example, to digital to analog converters or codecs for 
transmission to analog receiver circuitry. 

[0029] FIGURE 1 CIs a high level functional block diagram of a 
multichannel audio decoder 100 embodying the principles of the present 
invention. Decoder 100 is divided into two major sections, a Processor Block 
101 and the I/O Block 102. Processor Block 106 includes two digital signal 
processor (DSP) cores, DSP memory, and system reset control. I/O Block 102 
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includes interprocessor communication registers, peripheral I/O units with their 
necessary support logic, and interrupt controls. Blocks 101 and 102 
communicate via interconnection with the I/O buses of the respective DSP cores. 
For instance, I/O Block 102 can generate interrupt requests and flag information 
for communication with Processor Block 101. All peripheral control and status 
registers are mapped to the DSP I/O buses for configuration by the DSPs. 

[0030] FIGURE 2 is a detailed functional block diagram of processor block 
101. Processor block 101 includes two DSP cores 200a and 200b, labeled 
DSPA and DSPB respectively. Cores 200a and 200b operate in conjunction with 
respective dedicated program RAM 201a and 201b, program ROM 202a and 
202b, and data RAM 203a and 203b. Shared data RAM 204, which the DSPs 
200a and 200b can both access, provides for the exchange of data, such as 
PCM data and processing coefficients, between processors 200a and 200b. 
Processor block 101 also contains a RAM repair unit 205 that can repair a 
predetermined number of RAM locations within the on-chip RAM arrays to 
increase die yield. 
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[0031] DSP cores 200a and 200b respectively communicate with the 
peripherals through I/O Block 102 via their respective I/O buses 206a, 206b. The 
peripherals send interrupt and flag information back to the processor block via 
interrupt interfaces 207a, 207b. 

5 [0032] FIGURE 3 is a detailed functional block diagram of I/O block 102. 
Generally, I/O block 102 contains peripherals for data input, data output, 
communications, and control. Input Data Unit 1300 accepts either compressed 
analog data or digital audio in any one of several input formats (from either the 
GDI or DAI ports). Serial/parallel host interface 1301 allows an external 
10 controller to communicate with decoder 100 through the HOST port. Data 
received at the host interface port 1301 can also be routed to input data unit 
1300, 

[0033] IPC (Inter-processor Communication) registers 1302 support a 
control-messaging protocol for communication between processing cores 200 
15 over a relatively low-bandwidth communication channel. High-bandwidth data 

WSM Docket No. 
2836-P125US 



(I 



i 



ATTORNEY DOCKET NO. PATENT 
1075-CA 

14 



can be passed between cores 200 via shared memory 204 in processor block 
101. 

[0034] Clock manager 1 303 is a programmable PLL/clock synthesizer that 
generates common audio clock rates from any selected one of a number of 
5 common input clock rates through the CLKIN port. Clock manager 1303 includes 
an STC counter which generates time information used by processor block 101 
for managing playback and synchronization tasks. Clock manager 1303 also 
includes a programmable timer to generate periodic interrupts to processor block 
101. 

10 [0035] Debug circuitry 1304 is provided to assist in applications 

development and system debug using an external DEBUGGER and the DEBUG 
port, as well as providing a mechanism to monitor system functions during device 
operation. 

[0036] A Digital Audio Output port 1305 provides multichannel digital audio 
15 output in selected standard digital audio fomnats. A Digital Audio Transmitter 
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1306 provides digital audio output in formats compatible witli S/PDIF or 
AES/EBU. 

[0037] In general, I/O registers are visible on both I/O buses, allowing 
access by either DSPA {200a)or DSPB {200b). Any read or write conflicts are 
5 resolved by treating DSPB as the master and ignoring DSPA. 

[0038] The principles of the present invention further allow for methods of 
controlling the tone levels of decompressed audio data, as well as for methods 
and software for operating decoder 100. These principles will be discussed in 
further detail below. Initially, a brief discussion of the theory of operation of 
10 decoder 100 will be undertaken. 

[0039] In a dual-processor environment like decoder 100, it is important to 
partition the software application optimally between the two processors 200a, 
200b to maximize processor usage and minimize inter-processor communication. 
For this, the dependencies and scheduling of the tasks of each processor must 
15 be analyzed. The algorithm must be partitioned such that one processor does 
not unduly wait for the other and later be forced to catch up with pending tasks. 
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For example, in most audio decompression tasl<s including Dolby AC-3®, the 
algorithm being executed consists of 2 major stages: 1) parsing the input 
bitstream with specified/computed bit allocation and generating frequency- 
domain transform coefficients for each channel; and 2) performing the inverse 
5 transform to generate time-domain PCM samples for each channel. Based on 
this and the hardware resources available in each processor, and accounting for 
other housekeeping tasks the algorithm can be suitably partitioned. 

[0040] Usually, the software application will explicitly specify the desired 
output precision, dynamic range and distortion requirements. Apart from the 

1 0 intrinsic limitation of the compression algorithm itself, in an audio decompression 
task the inverse transform (reconstruction filter bank) is the stage which 
determines the precision of the output. Due to the finite-length of the registers in 
the DSP, each stage of processing (multiply+accumulate) will introduce noise 
due to elimination of the lesser significant bits. Adding features such as rounding 

1 5 and wider intermediate storage registers can alleviate the situation. 
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[0041] For example, Dolby AC-3® requires 20-bit resolution PCM output 
which corresponds to 120clB of dynamic range. The decoder uses a 24-bit DSP 
which incorporates rounding, saturation and 48-bit accumulators in order to 
achieve the desired 20-bit precision. In addition, analog performance should at 
5 least preserve 95dB S/N and have a frequency response of +/- 0.5dB from 3 Hz 
to 20 kHz. 

[0042] Based on application and design requirements, a complex real-time 
system, such as audio decoder 100, is usually partitioned into hardware, 
firmware and software. The hardware functionality described above is 
1 0 implemented such that it can be programmed by software to implement different 
applications. The firmware is the fixed portion of software portion including the 
boot loader, other fixed function code and ROM tables. Since such a system can 
be programmed, it is advantageously flexible and has less hardware risk due to 
simpler hardware demands. 

1 5 [0043] There are several benefits to the dual core (DSP) approach 

according to the principles of the present invention. DSP cores 200A and 200B 
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can work in parallel, executing different portions of an algorithm and increasing 
the available processing bandwidth by almost 100%. Efficiency improvement 
depends on the application itself. The important thing in the software 
management is correct scheduling, so that the DSP engines 200A and 200B are 
not waiting for each other. The best utilization of all system resources can be 
achieved if the application is of such a nature that can be distributed to execute 
in parallel on two engines. Fortunately, most of the audio compression 
algorithms fall into this category, since they involve a transfomi coding followed 
by fairly complex bit allocation routine at the encoder. On the decoder side the 
inverse is done. Firstly, the bit allocation is recovered and the inverse transform 
is performed. This naturally leads into a very nice split of the decompression 
algorithm. The first DSP core (DSPA) works on parsing the input bitstream, 
recovering all data fields, computing bit allocation and passing the frequency 
domain transform coefficients to the second DSP (DSPB), which completes the 
task by performing the inverse transform (IFFT or IDCT depending on the 
algorithm). While the second DSP is finishing the transform for a channel n, the 
first DSP is working on the channel n+1 , making the processing parallel and 
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pipelined. The tasks are overlapping in time and as long as tasks are of similar 
complexity, there will be no waiting on either DSP side. Once the transform for 
each channel is completed, DSPB can postprocess this PCM data according to 
the desired algorithm, which could include digital tone control. 

5 [0044] Decoder 1 00, as discussed above, includes shared memory of 544 
words as well as communication "mailbox" (IPC block 1302) consisting of 10 I/O 
registers (5 for each direction of communication). FIGURE 4 is a diagram 
representing the shared memory space and IPC registers (1302). 

[0045] One set of communication registers looks like this: 

10 [0046] (a) AB_command_register(DSPA write/read, DSPB read 
only) 

[0047] (b) AB_parameter1_register(DSPA write/read, DSPB 
read only) 

[0048] (c) AB_parameter2_register (DSPA write/read, D^B 
1 5 read only) 
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[0049] (d) AB_message_semaphores (DSPA write/read, DSP B 

write/read as well) 

[0050] (e) AB_shared_memory_semaphores (DSPA write/read, 

DSP B read only) where AB denotes the registers for communication from DSPA 
5 to DSPB. Similarly, the BA set of registers are used in the same manner, with 
simply DSPB being primarily the controlling processor. 

[0051] Shared memory 204 is used as a high throughput channel, while 
communication registers serve as low bandwidth channel, as well as semaphore 
variables for protecting the shared resources. 

1 0 [0052] Both DSPA and DSPA 200a, 200b can write to or read from shared 
memory 204. However, software management provides that the two DSPs nejver 
write to or read from shared memory in the same clock cycle. It is possible, 
however, that one DSP writes and the other reads from shared memory at the 
same time, given a two-phase clock in the DSP core. This way several virtual 

1 5 channels of communications could be created through shared memory. For 

example, one virtual channel is transfer of frequency domain coefficients of AC-3 
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stream and another virtual channel is transfer of PCM data independently of AC- 
3. While DSPA Is putting the PCM data into shared memory, DSPB might be 
reading the AC-3 data at the same time. In this case both virtual channels have 
their own semaphore variables which reside in the 

5 AB_shared_memory_semaphores registers and also different physical portions 
of shared memory are dedicated to the two data channels. 
AB_command_register is connected to the interrupt logic so that any write 
access to that register by DSPA results in an interrupt being generated on the 
DSP B, if enabled. In general, I/O registers are designed to be written by one 

1 0 DSP and read by another. The only exception is AB_message_sempahore 

register which can be written by both DSPs. Full symmetry in communication is 
provided even though for most applications the data flow is from DSPA to DSP B. 
However, messages usually flow in either direction, another set of 5 registers are 
provided as shown in FIGURE 4 with BA prefix, for communication from DSPB to 

15 DSPA. 
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[0053] The AB_message_sennpahore register is very important since it 
synchronizes the message communication. For example, if DSPA wants to send 
the message to DSPB, first it must checl< that the mailbox is empty, meaning that 
the previous message was tal<en, by reading a bit from this register which 
controls the access to the mailbox. If the bit is cleared, DSPA can proceed with 
writing the message and setting this bit to 1 , indicating a new state, transmit 
mailbox full. DSPB may either poll this bit or receive an interrupt (if enabled on 
the DSPB side), to find out that new message has arrived. Once it processes the 
new message, it clears the flag in the register, indicating to DSPA that its 
transmit mailbox has been emptied. If DSPA had another message to send 
before the mailbox was cleared it would have put in the transmit queue, whose 
depth depends on how much message traffic exists in the system. During this 
time DSPA would be reading the mailbox full flag. After DSPB has cleared the 
flag (set it to zero), DSPA can proceed with the next message, and after putting 
the message in the mailbox it will set the flag to I. Obviously, In this case both 
DSPs have to have both write and read access to the same physical register. 
However, they will never write at the same time, since DSPA is reading flag until 
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it is zero and setting it to 1 , while DSPB is reading the flag (if in polling mode) 
until it is 1 and writing a zero into it. These two processes a staggered in time 
through software discipline and management. 

[0054] When it comes to shared memory a similar concept is adopted. 

5 Here the AB_shared_memory_semaphore register is used. Once DSPA 

computes the transform coefficients but before it puts them Into shared memoiy, 
it must check that the previous set of coefficients, for the previous channel has 
been taken by the DSPB. While DSPA is polling the semaphore bit which is in 
AB_shared_memory_semaphore register it may receive a message from DSPB, 

10 via internjpt, that the coefficients are taken. In this case DSPA resets the 

semaphore bit in the register in its interrupt handler. This way DSPA has an 
exclusive write access to the AB_shared_memory_semaphore register, while 
DSPB can only read from it. In case of AC-3, DSPB is polling for the availability 
of data in shared memory in its main loop, because the dynamics of the decode 

1 5 process is data driven. In other words there is no need to interrupt DSPB with 
the message that the data is ready, since at that point DSPB may not be able to 
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take it anyway, since it is busy finishing tiie previous channel. Once DSPB is 
ready to take the next channel it will ask for it. Basically, data cannot be pushed 
to DSPB, it must be pulled from the shared memory by DSPB. 

[0055] The exclusive write access to the AB_shared_memory_semaphore 
5 register by DSPA is all that more important if there is another virtual channel 

(PCM data) implemented. In this case, DSPA might be putting the PCM data into 
shared memory while DSPB is taking AC-3 data from it. So, if DSPB was to set 
the flag to zero, for the AC-3 channel, and DSPA was to set PCM flag to 1 there 
would be an access collision and system failure will result. For this reason, 
1 0 DSPB is simply sending message that it took the data from shared memory and 
DSPA is setting shared memory flags to zero in its interrupt handler. This way 
full synchronization is achieved and no access violations performed. 

[0056] For a complete description of exemplary decoder 1 00 and its 
advantages, reference is now made to coassigned U.S. Patent No. 6,081,783 
1 5 entitled "DIGITAL AUDIO DECODING CIRCUITRY, METHODS AND 
SYSTEMS". 
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[0057] As discussed briefly above, it is common in audio compression 
schemes to raise tlie numerical value of tlie audio samples, and in particular 
those which have been transformed into the frequency domain, to a fractional 
power during encoding to compress the dynamic range of the signal. The step 
5 size in the subsequent linear quantization therefore imparts a relatively equal 
amount of noise over the input sample amplitude range. Exemplary audio 
formats where this technique is employed include MPEG-1 and MPEG-2 Layer III 
(MPS) and MPEG Advanced Audio encoding (AAC), although the processing to 
obtain the frequency domain samples differ substantially. 

1 0 [0058] The operation of raising the numerical number of a sample is 

difficult to implement on a DSP, and in particular those based on a fixed point 
architecture. This Is particularly true when trying to maintain precision while at 
the same time minimizing MIPS and memory usage. For example, looi<up tables 
could be used, however given the large number of possible input values 

1 5 encountered in applications such as MPS and AAC these tables would become 
prohibitively large. This is especially true for the encoding process since the 
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number of possible input values is as large as the numeric precision allowed by 
the processor. Moreover, a series expansion, such as a Taylor series, could be 
performed; however, in this case, precision is sacrificed in order to keep the 
number of expansion terms reasonable and cover the large range of the input. In 
5 particular, for the calculation x^'^ which is used in MP3 and AAC encoding, this 
series expansion precision is insufficient, even when 12 terms are taken, with 

coefficients less that 10"''° past the third term. 

[0059] A prefen-ed procedure 500 for raising a numerical input value x to a 
fractional power M/N is illustrated in the flow chart of FIGURE 5. In this example, 

10 X will be assumed to take on values in the un-normalized range [1 , XmaJ for M, N 
integers. Values in the range (0,1) are simply handled by scaling the range up, 
with 0 being the special trivial case. As discussed further below, this procedure 
can also be used to take the logarithm of a given input value x. Procedure 500 is 
particularly useful in DSP applications, such as audio decoder 100, although not 

1 5 necessarily limited thereto. 
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[0060] 



At Step 501, the input value x is divided by a selected normalization 



factor A to obtain tlie normalized value x' where: 



[0061] 




[0062] 



Preferably, A is selected (Step 502) such that : 



[0063] 



(2) A = B^'^ ^ (Ar^) = B' 



kM 



[0064] 



At Step 503, the un-normalized range [1 , Xmax) of the input value x 



is partitioned into K number of equal intervals [B""^, B^''^''^'^), where B > x^ax >= 
B{k-i)n 1^ _ 0,1 ...(K-1). By varying the value of B, different performance 
tradeoffs are implemented. For example, if a small value of B (i.e. a large 
number of intervals) is chosen, greater precision is achieved in the calculation of 
k(x) discussed below, although additional complexity is introduced into the 
procedure of computing the intervals. On the other hand, if a larger value is 
chosen for B, the calculation of the intervals is less complex, but done at the 
expense of accuracy in calculating k(x). 
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[0065] Consequently, each equal interval [B"^, B^""^^'^) is mapped by the 
normalization factor B*"^ into the normalized range [1 , x'max), where x'max = B*^ 
since: 

[0066] (3) x' = x/B'^ 

5 [0067] At Step 504, the value of k(x) is determined. This could be done by 
calculating k(x) = floor[1/N * logB(x)+1]. This is an operation intensive calculation 
to perform, especially for fixed point processors. However, in accordance with 
the inventive concepts, k(x) is preferably determined using a much more straight 
forward operation. Specifically, at Step 504 comparisons are made to determine 

1 0 in which of the intervals [B*"^, B^'''"'^^ ) the input value x falls, from which k(x) is 
derived. It should be noted that this procedure is applicable to instances where x 
is less than 1, although the value of k must now be negative. 

[0068] Values for {x'f"^\ over the normalized range [1 , B^] have been 
calculated and stored in a look-up table of P entries, these entries indexed by 
1 5 mapping the value of x' to an appropriate index (Step 505) The number of values 
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stored will depend not only on B"^, but also the resolution (steps) in the values of 
^^y,^|.ulH) stored. As discussed further below, additional precision can be achieved 
using linear interpolation or the like upon retrieval of pairs of these stored values. 

[0069] The normalized value x' is then calculated at Step 506. This Is used 
5 to index the look up table using index values ixi' and 1x2' calculated as follows: 

[0070] (4) z' = (x'-1)*(P-1)/(B''-1); 

[0071] (5) ixi' = floor(z'); and 

[0072] (6) ix2' = ixi' + 1. 

[0073] The con-esponding stored value of (xi'/'^''^^ over the normalized 
1 0 range [1 , B^] is retrieved using the index ixi' at Step 507, along with the value 
^j^^,yM/N) \^^Qy^ jx2'. Depending on the resolution of the values in the look-up 
table, linear interpolation can be performed to increase the precision. Since, x'i < 
x' < x'2and the values for (x'O^'^'^^and (x'2/'^^^ have been retrieved from the look- 
up table, then at Step 508 a linear interpolation is performed: 
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[0074] (7) (x')^''^''^ ^ aix'^i"^^ + (1 - a)(x'2r^) , where: 

[0075] (8) a = 1 - (z' - ix'i). 

[0076] A series expansion can also be implemented instead of the 

look-up table retrievals and linear interpolation over the limited normalized range, 
5 with good performance. 

[0077] To obtain the final value of x^^^\ renormallzation is performed at 
Step 509 by multiplying the final result (interpolated, expanded or directly taken 
from the lookup table) by the renormallzation factor B*^^: 

[0078] (9) x(^'^) = (x'r'") * A^^^^^ = (x')^^'') * B^^ 

1 0 [0079] Renormallzation is a straightforward calculation since B'^'^ is easily 
computable and B, k and M are known. Typically, b"^*^ is retrieved by looking up 
a prestored value. 
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[0080] In instances where M > N, greater accuracy can be achieved by 
splitting x^^^^ into x"^^ * x^^z/n) _ where M = Mi*N + M2 and M2 < N, calculating 
j^(M2/N) ^gj^g Qpig Qf tj^Q procedures described above, and then multiplying the 

result by x'^^ The procedure described above can also be used to calculate the 
5 logarithm, to a given base, for a given input value x. In this case, x is normalized 
such that the normalized value x' falls with in a selected range. The logarithm of 
X' is then calculated over that range, using either the look-up table, look-up table 
with interpolation or series expansion approach. Finally the calculated value is 
added to the interval times log B to obtain the actual value of log x. 

1 0 [0081] The concepts generally described above have distinct advantages 
when operating on binary data. In particular, with appropriate parameter 
selection, the process of raising a number to a fractional power can be reduced 
to a series of fundamental operations, such as left and right shifts and a table 
look-up operation. Consider the following example.' 
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[0082] Assume that the quantity being evaluated is x^'"^ (i.e. M =3, N =4) 
and that the B = 2, since the data is binary. Also assume that the operations are 
taking place in a 24-bit processing architecture using 5 bits for fractional 
representation such that X^ax = (2^^ -1)/2^ The values of x, x', A and k for this 
5 set of conditions are tabulated in Table 1 : 



TABLE 1 





x 


x' = x/A 


A= 2'' 


k 


Shift 1 


Shift 2 




[1/16...31/3 


[1...16) 


1/16 


-1 


L-18 


R-15 




2) 














[1, 1 1/32, 


[1...16) 


1 


0 


L-14 


R-12 




1 2/32...15 














31/32] 














16, 16 


[1...16) 


16 


1 


L-10 


R-9 




1/32... 255 














31/32] 














[256..2^2 - 


[1...16) 


256 


2 


L-6 


R-2 




1/32] 














[2^2..2i6. 


[1...16) 




3 


L-2 


R-3 




1/32] 
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10 



^2^6 220. 
1/32] 


[1...16) 




4 


R-2 


0 















[0083] Note that 0 is a trivial special case anc 
by forcing its % power to be zero. All other fixed point cases of interest are 
covered above. 

[0084] In this example, the values of x are nornnalized to values x' within 
the range [1 , .., 16]. The range [1,16] is partitioned into a 241 entry table, with 
indices in the range 0 to 240 storing values of (x')'''* in steps of 1/16 from to 
(16)'''' (This resolution was arbitrarily chosen for this example, and may change 
between implementations. In general, a P-element table will result in the storage 
of (x')''^' for R = (B^ - 1) / (P - 1) fractional steps of resolution). 

[0085] Specifically, these entries are populated with corresponding values 
of (x')^'"^ in the range from I'''' to (16)'''' . Hence, in this example Entry is 
populated with the value f ^ , Entry 1 with the value (1 M^Qf\ and so on with 
Entry 240 (the 241*' element) is populated with the value (16)^'^ Preferably, the 
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entries are stored in the 5.19 format. (Since the largest value in the table (16)'^^"^ 
simply equals 8, four integer bits are required along with one sign bit and, for 24- 
bit data, the remaining 19 bits represent the fractional part.) 

[0086] Continuing with the example, assume that x takes on the value of 
5 17 1/32. In 19.5 binary form (1 sign bit, 18 integer places, 5 fractional places, 
Base 2), this becomes: 

[0087] 0 00 0000 0000 0001 0001 .00001 

[0088] This value is shifted by the number of places and in the direction 
specified in the Shift 1 column of Table 1 . The number of places in the shift is a 

1 0 function of the number of integer bits required to represent the integer part x. For 
example, if x is in the range [1,16) then four integer bits are required to represent 
the integer part and a left shift of 14 places is performed. On the other hand, if x 
is in the range [16, 256), 8 integer bits are required for the integer and a shift left 
of 10 places is needed. For the 17 1/32 example, the shift Is left by 10 places 

15 such that x' becomes (in 5.19 format): 
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[0089] 0 0001.0001 00001 0000 0000 00 

[0090] This X' is adjusted by subtracting 1 to get z' as 
[0091] 0 0000.0001 0000 1000 0000 000 

[0092] Since ({P-1 )/(B ^ -1 )) = 240/1 5 = 1 6, the binary point is shifted right 
5 (value shifted left) by 4=LGg 2 1 6 places to obtain the index. 

[0093] The upper 8 bits (not including the sign bit), representing the 
integer 1 are used to index the (x')'''* look-up table value and the lower 15 bits, 
representing the fraction 1/32, are used as the interpolation factor a. In this 
case, the look-up table entry at index 1 is {^7l^6f\ The value {^mGf'^ from 
1 0 Entry 2 is also taken for Interpolation. 

[0094] One method of interpolation is to apply linear interpolation using 
entries 1 and 2 and the a taken from the fractional part of 2', after shifting, using 
linear interpolation in accordance with Equation (6) above. 
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[0095] Once the interpolated value of (x') is found, x""^ is found by 
multiplying {x'f^ by B"^*^ to renormalize. In this case, since B = 2, this is done by 
simply shifting by the amount Shift 2 in Table 1 to obtain x^'"^ in the 15.9 binary 
format. 

5 [0096] A similar procedure can be used to obtain the inverse x'^'^, which 

1/3 

becomes useful in decoding the compressed data. Here x is computed using 
the above method, and the result multiplied by x to obtain x^''^ . 

[0097] Although the present invention and its advantages have been 
described in detail, it should be understood that various changes, substitutions 
1 0 and alterations can be made herein without departing from the spirit and scope of 
the invention as defined by the appended claims. 
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